
IMPROVEMENTS IN OR RELATING TO 
DYNAMIC MEDICAL IMAGING 

5 BACKGROUND 

The present invention relates to dynamic medical imaging, that is to say the 
acquisition of a plurality of time separated images of a subject in order to reveal some 
aspect of the medical condition of the subject. 

Medical imaging is a technology that has evolved substantially over the past few 

10 decades with an increasing diversity of modalities - Magnetic Resonance Imaging 

(MRI), Computed Tomography (CT), Nuclear Medicine (NM) and Positron Emission 
Tomography (PET) - to name but a few. Although the traditional notion of medical 
imaging involves the acquisition of a "static" image that captures the anatomy of an 
organ/region of the body, increasingly the use of more sophisticated imaging techniques 

1 5 allows dynamic studies to be made which provide a temporal sequence of images which 
can characterise physiological or pathophysiological information. 

Both static and dynamic medical imaging may involve the use of an imaging 
technique to increase selectively the contrast of a certain region in the image (e.g. on the 
basis of that region's structure or physiological state). For example, one may inject into a 

20 patient a compound which has a biophysical, molecular, genetic or cellular affinity for a 
particular organ, disease, state or physiological process. Such contrast agents are 
selected to have a property that provides enhanced information to a given imaging 
modality by altering imaging conditions (normally by altering the contrast) to reflect the 
behaviour of the compound in the body. This may be achieved via increased X-ray 

25 attenuation a localised site (e.g. for CT/X-ray), altered paramagnetic properties (e.g. for 
MRI) or the use of a radioisotope for nuclear medicine/PET. Such contrast agents are 
well-known for many imaging modalities. In some cases a technique may be used to 
create a contrast enhancement which does not rely on an injected contrast agent, for 
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instance the use of "black blood" or "white blood" in magnetic resonance (MR) imaging 
(where specific pulse sequences are used to change the magnetic saturation of the blood 
and thus its appearance in the image), or tagged MR sequences which alter the magnetic 
behaviour of particular tissue or fluid. An injected contrast agent, or a tissue or fluid 
5 with altered behaviour, may all be regarded as "imaging agents". 

Analysis of the behaviour of an imaging agent through imaging typically involves 
an acquisition process that takes many "snapshots" of the organ/region/body over time in 
order to capture the time-varying behaviour, e.g. distribution, of the agent and hence 
capture a specific biological state (disease, condition, physiological phenomenon, etc.). 

10 As the speed and digital nature of medical imaging evolves, this acquisition data can 
have tremendous temporal resolution and results in large quantities of data. 

Additionally, there is a growing interest in not only imaging a particular 
physiological phenomenon to characterise a disease or condition, but also the in vivo 
assessment of the change in disease in response to therapy. This therapy may be 

1 5 surgical, pharmacological/genetic or radiotherapeutic in nature. Whether for diagnosis 
or treatment assessment purposes, dynamic imaging is a powerful clinical tool and has 
not only altered the landscape of medical imaging but has also made substantial inroads 
into drug discovery and animal applications. 

Irrespective of the application, dynamic imaging with an imaging agent requires a 

20 temporal (multiple time epoch) acquisition during which the behaviour of the imaging 
agent is characterised. Sometimes this characterisation involves known physiological, 
cellular or genetic models that may have arbitrary interaction complexity. Sometimes 
this characterisation is performed using mathematical or statistical models that abstract 
true physiological meaning but which may enable certain parameters to be calculated 

25 which indicate the behaviour of the imaging agent and hence provide diagnostic 
information. 

A patient may need to spend considerable time in an imaging device in order to 
acquire an image sequence. During this time, a patient may move - either due to natural 
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bodily motion (respiration, "physiological tremor", etc) or as part of a symptom of 
disease (e.g. lack of motor control by an Alzheimer's patient). This motion necessarily 
corrupts the temporal accuracy of the imaging process, making it difficult to compare 
and, more critically, analyse individual regions of the imaging process. 
5 Algorithms and clinical methods to address motion have long been a focus of 

research in medical imaging. Various techniques for motion correction, often involving 
registering images together to match corresponding locations in the image to each other, 
have been proposed, see for example WO 00/57361 and D. Rueckert, C. Hayes, C. 
Studholme, P. Summers, M. Leach, D. Hawkes, "Non-Rigid Registration of Breast MR 
10 Images Using Mutual Information", in Proc. MCCAI (Medical Image Computing and 
Computed Assisted Intervention), 1998, pp. 1 144-1 152, ISBN 3-540-65136-5, Springer 
Verlag. However such methods have failed to address the following issues: 

1) The validity of the motion correction. 

2) Feedback to the user about the quality of the motion correction in a region of 
15 interest. 

3) Feedback to the motion correction process itself regarding correction quality 
and analytical usefulness of the motion correction data. 

In virtually all dynamic imaging studies that involve an imaging agent, the 
behaviour of the agent can be mathematically characterised at some level or another. In 

20 the most simplistic fashion the behaviour of an imaging agent such as an injected 

compound may be analysed using a model of "uptake" and possibly subsequent "wash 
out", which may be linear or non-linear in nature. In more sophisticated instances, 
biophysical and pharmacokinetic understanding enables an imaging agent to be analysed 
using complex models that describe many different phases of behaviour and interaction. 

25 This is illustrated in Figure 1 of the accompanying drawings, which show a dynamic MR 
imaging sequence of the breast as a contrast agent is injected. The left breast (on the 
right in the displayed coronal slice) is the region of interest, where the suspicious area 
needs clinical investigation using contraced-enhanced MRI. Figure 1(a) illustrates the 
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baseline image, that is to say with no imaging agent. Figure 1(b) schematically 
represents the injection of contrast agent and the enhancement of the breast starts in 
Figure 1(c), continues in Figure 1(d) and finishes later in Figure 1(e) with high 
enhancement of the breast. Figure 1(f) represents the amount of image enhancement of 
5 the circled region in the image of Figures 1 (a),(c), (d) and (e) plotted as a function of 
time. This can be fitted to the expected mathematical model of the uptake and washout 
rates of this contrast agent and from the fitted curve a value for the uptake rate and 
washout rate can be calculated. These values can be used to characterise the tissue in the 
circled region as cancerous or normal. 

10 However, Figure 1 illustrates schematically the ideal case where there is no 

patient movement. If the patient moves, this adds noise or corrupts the imaging 
information that is used for this dynamic analysis. Without motion correction, it can be 
understood that this will change the values for apparent image enhancement at any 
particular part of the breast (because the values will not be referring to the same part of 

1 5 the breast before and after movement). Thus if patient motion occurs it is no longer 
possible to analyse accurately the temporal characteristics of an imaging process. 

Figure 2 illustrates two sequences of images, a first in which motion is not 
corrected and a second in which motion is corrected. In the first sequence Figure 2(a) is 
a baseline (i.e. before injection of contrast agent) magnetic resonance image of another 

20 breast clinical case. Figure 2(b) shows the image after a gadolinium contrast agent has 
been injected. An easy way to judge the amount of enhancement, and thus isolate the 
tumourous region, is to subtract the two images of Figures 2(a) and 2(b). This results in 
the subtraction image of Figure 2(c). Unfortunately because the patient moved between 
the pre-contrast and post-contrast images of Figures 2(a) and 2(b), the subtraction image 

25 of Figure 2(c) contains many artefacts that suggest enhancement, but are in fact 

erroneous. One of the known motion correction techniques of registering the pre- and 
post-contrast images to each other can be used to find the motion field in the image. A 
suitable technique is disclosed in WO 00/57361 (herein incorporated by reference). The 
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resulting motion field is shown in Figure 2(d). It can be seen that there is significant 
motion in the right-hand part of the breast, but no motion in the left-hand part. The post- 
contrast image can be motion corrected to remove the movement resulting in the 
corrected image of Figure 2(e), and then this is subtracted from the pre-contrast image of 
5 Figure 2(a). The corrected subtraction image is shown in Figure 2(f) and it can be seen 
that many motion artefacts have been removed (for example the highly visible artefacts 
around the edge of the breast in Figure 2(c)), and the region corresponding to contrast 
enhancement (for instance tumours) within the breast is more clearly visible. 

Although such motion correction techniques are useful, they are often regarded 
10 with suspicion by clinicians. This is especially true of non-rigid, or deformable, 

corrections where clinicians worry that the changes introduced by the motion correction 
may disguise clinically significant features. This has lead to a slow take-up in practice of 
the advantages given by registration techniques. 

1 5 SUMMARY OF THE INVENTION 

The present invention provides a method of dynamic medical imaging in which 
the expected temporal characteristics of the imaging process, e.g. the model of behaviour 
of the imaging agent, is used to optimise a motion correction process, such as one of the 
known methods of registration, and to provide feedback to the user as to the quality of 
20 motion correction. 

Thus the knowledge about the temporal behaviour of the imaged region can be 
used not only in the conventional diagnosis, but also to validate the motion correction. 
Further, if the motion correction is found by this method to be poor, it provides a way of 
identifying regions within the subject where the motion correction is poor, allowing 
25 them to be processed further, for instance using different parameters in the motion 

correction method. The invention also provides quality-control information to the user 
of the dynamic/temporal medical imaging study. 

In more detail the present invention provides a method of dynamic medical 
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imaging comprising the steps of:- 

obtaining a plurality of time separated images of the subject; 

registering the plurality of time separated images together to match 
corresponding locations in the images to each other; 
5 measuring from the registered images the temporal behaviour of an imaged 

region at a location in the subject; and 

comparing the measured temporal behaviour with a model of the expected 
temporal behaviour of the imaged region to determine the level of agreement 
therebetween as a measure of the quality of the registration of the time separated images. 
10 Thus the expected behaviour of the imaged region is used to measure the quality 

of the registration. 

The images may be acquired in a process involving the use of an imaging agent. 
The imaging agent may be the subject's own tissue or fluid or a contrast agent which is 
administered to the subject as mentioned above. 
15 The level of agreement between the measured and expected temporal behaviour 

may be displayed to the user, for instance overlying an image of the subject, for example 
as a colour wash with different colours or intensities indicating the level of agreement. 

The method may further include the step of re-executing the image registration in 
regions of the image where the level of agreement is poor. This may be achieved by 
20 using different parameters, such as using a different resolution, different scale or 
different sized search windows in the registration process. 

The model may be a temporal model of the take-up and wash-out of an imaging 
agent and the subject of the imaging process may be a living human, animal or plant. 

The technique is applicable to any dynamic imaging technique such as magnetic 
25 resonance imaging, computed tomography, positron emission tomography, nuclear 
medicine, ultrasound, x-ray and optical imaging. 

The invention may be embodied as a computer program comprising program 
code means for executing the registration, measurement and comparison steps on a 
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programmed computer, and the invention extends to a computer readable storage 
medium carrying such a program and to a computer system programmed to execute the 
method. 



5 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be further described by way of example with reference to the 
accompanying drawings, in which:- 

Figure 1(a) to (g) illustrate schematically the prior art concept of dynamic 
imaging using an imaging agent and the process of analysis; 
10 Figures 2(a) to (f) illustrate two sequences of MR images of a contrast-enhanced 

breast illustrating the techniques of motion correction; 

Figure 3(a) to (f) illustrates in similar fashion to Figure 1 the verification of the 
motion correction using the model of imaging agent behaviour; 

Figure 4 illustrates a schematic flow diagram of the process of one embodiment 
15 of the invention; and 

Figure 5 illustrates the application of one embodiment of the invention to a 
recalculation of motion correction. 

DETAILED DESCRIPTION 

20 Referring to Figures 3 and 4 an embodiment of the invention based on the MR 

imaging technique of Figure 1 will be described. Firstly in step 400 of Figure 4 a 
dynamic image sequence is acquired from a patient 42 using an imaging apparatus 46 
during injection of an imaging agent 44 such as Gadolinium DTP A (Diethyline Tri amine 
Pentaacetic Acid). The sequence is illustrated schematically in Figure 3(a). It is assumed 

25 that there is some patient head motion in the imaging sequence. In step 402 a 

registration process is carried out to correct the patient motion. The technique may be 
that described in WO 00/5736 1. Then the temporal behaviour of the enhancement in a 
particular part of the image is measured in step 404 - the values of enhancement against 
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time are plotted as crosses in Figure 3(b). The continuous line in Figure 3(b) illustrates 
the fitted model, for example in this case the fitted model of the enhancement rate for 
this imaging agent. Comparing this with Figure 1(g) it can be seen that the fit is quite 
poor, this being caused by patient movement. Figure 3(c) illustrates the numerical fitting 
5 error calculated in step 406, i.e. the difference between the value of the data point and 
the fitted curve. 

Incidently, it is possible to apply steps 404 and 406 before applying any image 
registration algorithm, i.e. before step 402. 

The amount of error is displayed in step 407, for example as an overlay whose 

10 colour and/or intensity indicate the level of error, or as lines whose length indicate the 
amount of error. This display gives the user an indication of the quality of the motion 
correction. If the fit is very poor, this is taken to indicate that there is a substantial 
degree of patient motion. On the other hand, if the fit is good, this indicates that the 
patient has not moved much. Obviously there may be different qualities of fit for 

1 5 different parts of the image where some parts of the subject moves but not others. 

In this embodiment in regions of the image where the fit is not good enough as 
indicated by step 408, the motion correction is re-executed in step 410 and the model of 
the temporal behaviour of the imaging agent is fitted again to the data. The motion 
correction can be done by any of the following, for example: 

20 a) addition of extra control points of a parametric transformation in areas or 

misalignment as shown in Figure 5; 

b) locally loosening stiffness and regularisation constraints in areas of 
misalignment in the computation of a displacement field; 

c) locally changing the scale of the displacement field characteristics; and 

25 d) locally changing the characteristics of local block (size, search, step, etc.) in a 

block matching technique. 

Steps 406, 408 and 410 are repeated iteratively until the residual error is 
acceptable or at a minimum. This is illustrated in Figures 3(d) and (e), where Figure 3(e) 
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illustrates the corrected data points and the much better fit to the model curve. Figure 
3(f) illustrates the residual error, now much lower than in Figure 3(c). When the fit is 
good enough the newly corrected motion image can be displayed in step 412 and the 
diagnostic parameters such as the wash-in rate and wash-out rate can be calculated 
5 taking into account the improved motion correction. 

Thus the present invention combines the knowledge about the temporal 
behaviour of the imaging agent with the motion correction process in order not only to 
improve the motion correction process and give an indication of its quality, but also to 
produce ultimately a better motion corrected image which the temporal behaviour model 
10 fits, thus allowing a calculation of the diagnostic parameters even in regions of high 
patient motion. 

The imaging agents usable with the present invention are any of those suitable for 
magnet resonance imaging, computed tomography, positron emission tomography, 
single photon emission computed tomography, nuclear medicine, ultrasound, x-ray 

1 5 (including angiography) and optical imaging, and include ligands/chelates tagged to 
paramagnetic compounds (for MRI), radio-labelled tracers/radio pharmaceuticals or 
nuclear medicine, ionic radiation attenuators for CT and x-ray, receptor-specific imaging 
agents for cellular behaviour and interactions, genetic markers (radio-labelled, 
luciferase-labelled etc), blood pool agents and vascular imaging agents. 

20 The invention can be applied to two-dimensional or three-dimensional imaging 

processes. 



-9- 



